Comments on “MoNuSAC2020: A Multi-Organ Nuclei Segmentation and Classification Challenge”

The MoNuSAC 2020 challenge was hosted at the ISBI conference, where winners were announced. Challenge organizers, in addition to leaderboard, released evaluation code and visualisations of prediction masks “top 5” teams. This shows a very high level transparency, provides unique opportunity better understand results. Our analysis all data, however, three different problems computation metric used for official ranking: coding mistake resulting erroneous false positives; another missed problem with metric’s aggregation method. We demonstrate errors, confirm that mistaken version indeed rank algorithms challenge. results can be fully replicated provided on GitHub.